SEGMENTATION METADATA FOR AUDIO-VISUAL CONTENT 



BACKGROUND OF THE INVENTION 

The present invention relates to descriptions of audio-visual material 

Digital audiovisual material is becoming increasingly available to users 
through digital TV broadcast, digital video cameras, digital video discs, and personal 
computer based access to multimedia on the Internet or other network. In addition, 
persistent large-volume storage and non-linear access to audiovisual content is becoming 
available in consumer devices. Consequently, there is a need for rapid navigation and 
searching capabilities to enable users to efficiently discover and consume the contents of 
audiovisual material. 

The extensive proliferation of audio-visual material available to users has 
the potential to overwhelm the consumer and lead to frustration at the inability to search 
and view content in an efficient manner. Viewing summaries of the content allows the 
consumer to skip irrelevant content and view the desired content quickly and easily. 
Further, multiple different summaries, if available, may provide the user with alternative 
views of a particular program that the user could choose from depending on personal 
preferences or usage conditions. 

Limited summary selection capabilities are appearing more frequently in 
current technologies, such as the digital video disk (DVD). DVD movies normally 
provide "scene selections" or "chapter selections" that have a visual array of thumbnails 
and textual titles associated with each scene. This permits the user to click on the 
thumbnail of the desired scene, jump to that scene, and start playback. Playback typically 



continues until the end of the movie, unless the user makes another selection. While 
somewhat limited, these features provide the capability to index for the purpose of 
jumping to an arbitrary position and continue playback from that position. 

Referring to FIG. 1, a system 10 may be used for the presentation of video, 
audio, or audiovisual information to a user. The information may be presented to the user 
using any suitable medium, such as for example, the Internet, a computer network, the 
radio, a personal computer, and a television. The user or the user's agent interacts with 
the system 10 to receive the information in a desirable manner and to define preferences 
as to what type of information is obtained. The term user is intended to refer to the 
recipient of the information, which may be for example, a person, a machine, or a 
software program operating on a machine. 

To define these interactions, a set of description schemes containing data 
describing the content of the material may be used. User preferences 12 may be used in 
several different areas to maximize both the user's enjoyment and the system 
functionality. The preferences describing the topics and subject matter of interest to the 
user is used in both searching for and navigating the audiovisual programs 14. These two 
sets of data, the user preferences 12 and program descriptions 14, are correlated in the 
filtering and search engine 16 to identify the preferred programs. 

The programs identified by the filtering and search engine 16 are then 
forwarded to a browsing module 1 8 along with the user's browsing preferences. Another 
output of the filtering and search engine 16 are preferred programs that the user has 
designated for storage. These are stored in the storage module 20. The programs selected 
by the user with the browsing module 18 are then sent to a display 22. The user may 



utilize multimedia title descriptions of preferred programs to navigate among the 
programs that the user wants to consume. Once a program is selected, a summary 
description of that particular program is correlated with user's browsing preferences to 
offer the user a preferred summary. 

The display 22 receives the programs and displays them in accordance with 
the user's device preferences as to the operation of the display. User's device preferences 
may include, for example, device settings such as volume setting that may vary with the 
genre of the program that is being consumed. The display and user's interaction with the 
display, such as stopping a program before its end and consuming certain types of programs 
with certain device settings, also provides information in a manner analogous to a feedback 
loop to update and log the usage history 24. The usage history 24 may be mapped against 
the preferences by a mapping module 26. This information is then used in conjunction with 
user inputs by the user preference module 12. 

These user preferences may be useful in many contexts, not just an 
audiovisual presentation system. User preferences and usage history may be transmitted 
to the provider of audiovisual programs 14 to receive selected programming or directly 
receive program segments that are preferred by the user. In the latter case, user 
preferences may be correlated with summary descriptions at the provider side to select 
and directly deliver summarized audiovisual programs to the user. The preferences may 
also be transferred to a "smart card" 28 or similar, portable storage and ultimately 
transferred to another system by the user. 

However, it is noted that a framework for the description of the individual 
description schemes at the user, program, or device level are needed. As illustrated in 



FIG. 1, the audiovisual programs 14 includes descriptions of the programs in a description 
framework. The description framework can have several different types of descriptive 
structures, such as those described in MPEG-7, incorporated by reference herein. 
Referring to FIG. 2, one particular type of potential description scheme is related to 
searching. Searching includes information related to the content of the media, such as for 
example, actors, title, genre, etc. The searching description scheme, as described in 
MPEG-7, corresponds to a single video as a whole. A different searching description 
scheme is included for each video. Referring to the entire video is consistent with the 
desire of the user to quickly search the available videos for particular content related to 
the videos as a whole. Another type of description scheme is related to navigation. The 
navigation description scheme includes information related to navigating or otherwise 
selecting content for viewing, such as for example, table of contents, highlights, key 
frames, summaries, segments, etc. The navigation description scheme, as described in 
MPEG-7, corresponds to segments of the video. Referring to segments of the video is 
consistent with the desire of the user to navigate a particular video in a particular manner. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a system including preferences. 

FIG. 2 illustrates a searching description scheme and a navigation 
description scheme. 

FIG. 3 illustrates a combined searching and navigation description scheme. 

FIG. 4 illustrates a generic hierarchical relationship. 



FIG. 5 illustrates permitted grouping. 

FIG. 6 illustrates alternative groups. 

FIG. 7 illustrates a group and related segments. 

FIG. 8 illustrates a table of contents presentation. 

FIG. 9 illustrates a virtual program. 

FIG. 10 illustrates a temporal time base for video. 

FIG. 1 1 illustrates entity relationships. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The present inventors came to the realization that the previously existing 
searching description scheme (segment description scheme in MPEG-7) and the 
navigation description scheme (summary description scheme in MPEG-7), as described in 
MPEG-7, are inconsistent with one another if it is desirable to navigate portions of a 
video and simultaneously obtain information regarding the content of those portions. In 
particular, MPEG-7 does not provide sufficient syntax structures to physically or logically 
link the segments identified by the navigation description scheme with the video 
identified by the searching description scheme. Referring to FIG. 3, a modified 
description scheme syntax incorporates both information related to the searching 
description scheme and the navigation description scheme (e.g., segmentation description 
scheme), both within a single description scheme. Moreover, the incorporation of both 
the searching description scheme and the navigation description scheme into a single 
description scheme eliminates some redundant information. Within an XML syntax 



structure both the searching and the navigational descriptions are associated with the same 
segment definition (e.g., specifies physical location of segment within the video). 

The description scheme structure within MPEG-7 peraiits a hierarchical 
nesting structure for segment descriptions of the video and descriptions for groups of 
segments of the video. The permitted hierarchical nesting structure is very flexible and 
permits nearly any desirable interrelationship to be defined. Referring to FIG. 4, a sample 
hierarchical nesting structure is illustrated. While such a hierarchical nesting structure is 
flexible, it turns out to be extremely difficult determining the order to present the 
segments of video within such a structure. Within a particular level it is difficult to 
determine which segments to present first and is further complicated by determining 
which segment to present within the different hierarchical levels. Moreover, the parsing 
of such a structure is complex which reduces the computational efficiency of the system. 

To overcome the non-deterministic nature of the hierarchical structure the 
preferred system imposes at least one or more of the following restrictions. A segment 
group may reference either other segments or other segment groups, but not both, as 
illustrated in FIG. 5. A segment group references other segments or other segment 
groups, but does not contain segments itself. In some cases a segment group may 
reference a single segment or otherwise contain a single segment, in which case it is 
considered a segment. In this manner, any particular segment group will either reference 
a set of segments which may be readily ordered, or one or more segment groups. 
Segments may not reference other segments or segment groups. 

With the set of permissible interconnections limited a set of rules is useful 
in order to permit the user to view the available content in an organized manner or 



5 otherwise select a set of segments for presentation in a particular order. In this manner 
the playback, navigation, and presentation order may be unambiguously defined. 
Therefore different systems will interpret the segmentation data the same. One type of 
organizational technique is to define segments type "alternativeGroups", which may not 
contain segments and shall only contain subgroups. The user may select one of the 
10 groups from the set of groups at the same hierarchical level originating from the same 

parent group. Referring to FIG. 6, for example, the user may select Group 1 or Group 2. 
If Group 1 is selected, then the user may select Group 3 or Group 4. Group 3 consists of 
!Zj one segment. If Group 4 is selected, then the set of segments referenced by Group 4 are 

jp made available to the user. If the user selects Group 4 the segments defined within Group 

fjjjj 15 4 may be presented, as illustrated in FIG. 7. The order of presentation of the segments 
if defined by a Group may be presented to the user in an order defined by the order listed 

0 within the Group, such as the first in the list is first played or the last in the list is first 

played. 

JjJ Another type of organizational technique is to define a set of segments of 

20 type "tableOfContents", which presents the groups and segments defined therein in an 

ordered manner such that the hierarchical order may be observed. For example, a portion 
of the ordered groups shown in FIG. 6 may be organized as a tableOfContents, as shown 
in FIG. 8. The tableOfContents representation facilitates the user being able to select 
portions of video content that may be of particular interest to the user in a convenient 
25 manner. 

Portions of the hierarchical structure of segment groups may be designated 
as "alternativeGroups" and other portions of the hierarchical structure may be designated 
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as "tableOfContents". Preferably, the two different designations of the hierarchical 
structure are non-overlapping, but may be overlapping, if desired. These designations are 
preferably not directly associated with segments. 

Existing video summarization systems provide segmentation data for each 
video and permit the selective viewing of each video according to the segmentation data. 
While beneficial, the present inventors determined that facilitating the grouping of 
segments from a plurality of different programs to be viewed within a single presentation 
defined by a single description scheme is beneficial and not previously possible. A 
"virtual program" consisting of segments from a plurality of different programs may be 
dynamically constructed and presented, without the need for physically creating the 
program on a persistent storage medium. Thus the description scheme syntax may 
facilitate the identification of the "virtual program" where the relevant segments may be 
located with multiple different segments of multiple different programs being identified 
within a single description scheme syntax, as illustrated in FIG. 9. Thus for example, it is 
possible to view various news reports from different news sources in a sequence without 
having to individually manually select each news report from each news source. 

Principally, existing description schemes for audiovisual content permit 
linking to external content, such as a web site of a news article on a relevant topic or other 
material of related interest to the content. However, it was determined that more focused 
external content may be selected for the user if the content was associated with segments 
of the video, as opposed to the entire video. In this manner, a single video may include 
multiple links to external content, each link being associated with a different portion of the 
video. 



Another issue that arises with respect to selecting segments within multiple 
different video streams is the different techniques that may be used to indicate "time". For 
example, the frame rate is not always the same, with movie film typically being 24 frames 
per second and television being 30 frames per second (each frame consisting of two 
fields). In addition, the time base for MPEG-1, DVD's, MPEG-2, VCR, Movies, Internet 
based streaming media, etc., are not the same. Accordingly, the modified description 
scheme includes a time base indicator of the time base associated with the particular 
segment, as illustrated in FIG. 10. With the time base defined, either explicitly or 
implicitly, the beginning of the segment is defined together with an offset indicating the 
duration of the segment. The offset is in time units, such as seconds, minutes, frames, 
fields, etc., and may have a default or implicit definition. 

The following may be used to describe the descriptive properties of 

segments: 

<complexTypename="BasicSegmentDescriptionType"> 
<sequence> 

<element name="Title" type-"mpeg7:TitleType" 

minOccurs-'O" maxOccurs="unbounded7> 
<element name- 'Synopsis" type= "tva:SynopsisType" 

minOccurs-'O" maxOccurs-'unbounded7> 
<element name- 'Keywords" = "mpeg7:KeywordAnnotationType" 

minOccurs- f 0" maxOccurs- T7> 
<element name- 'RelatedMaterial" type= !! tva:RelatedMaterialType" 



5 



minOccurs="0" maxOccurs="unbounded7> 
</sequence> 
</complexType> 



10 



15 



20 



The terms and definitions may be as follows: 
BasicSegmentDescriptionType Defines basic segment description. 



Tittle 



Synopsis 



Keywords 



RelatedMaterial 



A title of the segment (optional). A segment can 
have several titles when necessary, e.g. in different 
languages. 

A synopsis of textual description of the segment 
(optional). A segment can have several synopses 
when necessary, e.g. in different languages or 
lengths. 

A keyword associated with the segment (optional). 
A segment can have several keywords when 
necessary, e.g. in different languages. 
A link to external material related to the segment 
(optional). A segment can have multiple links. 



The following element and complex type may be used to define a segment. 



<element name- 'Segment Information" 

type- 'tva: SegmentInformationType7> 
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<complexTypename- , SegmentInformationType !t > 



<sequence> 



<elementname="ProgramRef' type="tva:CRroRefType" minOccurs="07> 
<element name- 'Description" 

type^ !t tva:BasicSegmentDescriptionType !f minOccurs="07> 
<element name- 'SegmentLocator" type= !t mpeg7:MediaTimeType"/> 
<element name="KeyFrameLocator ,! type="mpeg7:MediaTimeType M 

minOccurs="0" maxOccurs="unbounded7> 



</sequence> 



<attribute name- 'segmentld" type- 'xsdilD" use- 'required7> 



<attribute name- Version" type- 'xsdiinteger" use= !! optionarV> 



</complexType> 



The terms and definitions may be as follows: 



Segmentlnformation 



An element that instantiates the SegmentlnformationType. 



S egmentlnformationType 



Defines an individual segment. 



ProgramRef 



A reference to the program this segment belongs to. When the 



ProgramRef element is not instantiated within a segment, the 



program that the segment belongs to is specified by the 



ProgramRef element of its parent segment group(s). 
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Description 



A description of the content of the segment. 



SegmentLocator Locates the segment within a program (instance) in terms of 

start time and duration (optional). Defined as an MPEG-7 
datatype, MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a 
detailed description). If the duration is not specified, the 
segment ends at the end of the program. If the timeBase 
and/or timeUnit attributes for the SegmentLocator element are 
instantiated, they override the default or global time base and 
time unit definitions provided with the 
SegmentlnformationTable description. 

KeyFrameLocator Locates a key frame of the segment within a program in terms 

of a time point (optional). Defined as an MPEG-7 datatype, 
MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a detailed 
description). MediaDuration and MedialncrDuration elements 
of a KeyFrameLocator element should not be used. Multiple 
key frames may be associated with a single segment. If the 
timeBase and/or timeUnit attributes for the KeyFrameLocator 
element are instantiated, they override the default or global 
time base and time unit definitions provided with the 
SegmentlnformationTable description. 
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segmentld 



The unique identifier of the segment. 



version The version number of the segment information (optional) . 

The following element and complex types may be used to define segment 

grouping. 

<element name- ' SegmentGroupInformation' 1 

type- ' tva: SegmentGroupInformationType7> 

<complexType>name= f, SegmentGroupInformationType"> 
<sequence> 

<element name="ProgramRef ' type= !, tva:CRIDRefType7> 

<element name- 'Description" type="tva:BasicSegmentDescriptionType M 

minOccurs="07> 
<element name- 'Grouplnterval" minOccurs="0"> 

<complexType> 

<attribute name="ref ' type=xsd:IDREF7> 

</complexType> 
</element> 

<choice minOccurs- '()" maxOccurs- r l"> 
<element name= M Segments"> 
<complexType> 
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<attribute name="refList" 
type=xsd:IDREFS' , use= t, required7> 
</complexType> 
</element> 
<element name- 'Groups" 
<complexType> 

<attribute name- 'refList" 
type=xsd:IDREFS" use="required7> 
</complexType> 
</element> 
<choice> 
</sequence> 

<element name="KeyFrameLocator M type- f mpeg7:MediaTimeType" 

minOccurs="0" maxOccurs= !, unbounded !f /> 
<attribute name="groupId" type- f xsd:ID" 

use= f, required f, /> 
<attribute name="groupType" type="tva:SegmentGroupTypeType ,! 

use-'required7> 
<attribute name-'ordered" type- 'xsdiboolean" 

use= ,! optionar7> 
<attribute name- 'numberOfSegments" type- f xsd:positiveInteger" 

use- f optional7> 

<attribute name- 'numberOfKeyFrames" type- 'xds:positiveInteger" 
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use="optional7> 
<attribute name="numberOfKeyFrames" type- 'xsdipositivelnteger" 

use="optional7> 
<attribute name- 'duration" type= !, mpeg7:mediaDurationType !, 

use="optional7> 
<attribute name- 'topLevel" type= !! xsd:boolean" 

use- ! optional7> 
<attribute name- Version" type- 'xsdiinteger" 

use="optional"/> 
</complexType> 

<simpleTypename-'SegmentGroupTypeType ,, > 
<list> 

<simpleType> 

Restriction base= "xsd:string"> 
<enumeration value= "highlights7> 
<enumeration value="highlights/obj ects 1 V> 
<enumeration value- f taghlights/events7> 
<enumeration value= M bookmarks ! V> 
Enumeration value^"bookmards/objects7> 
Enumeration value="bookmarks/events"/> 
<enumeration value="themeGroup7> 
<enumeration value-'preview"^ 
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Enumeration value="preview/title7> 
<enumeration value="preview/slideshow"/> 
<enumeration value="tableOfContents7> 
Enumeration value="synopsis7> 
<enumeration value- 'shots7> 
Enumeration value- 1 altemativeGroups7> 
<enumeration value="other7> 
</restriction> 
< /simpleType> 
</list> 

</simpleType> 

The names and definitions may be as follows: 

SegmentGroupInformation An element that instantiates the SegmentGroupInformationType. 

SegmentGroupInformationType Defines an individual segment group. 

ProgramRef A reference to the program this segment belongs to. When the 

member segments/groups are collected from different programs 
(e.g. to create a "virtual program") the ProgramRef element 
references a group CRID that is resolved into the individual 
programs CRIDs. 
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5 Description 



A description of the content of the segment group. 



Grouplnterval References a single segment that defines the temporal range of 

the segment group. 

Segments Defines the segments that are part of this group by providing a 

list of references to the identifiers of elements of type 
10 SegmentlnformationType (optional). The order of the references 

to segments in this list determines the ordering of segments 
within this group. 

Defines the segment groups that are subgroups of this group by 
providing a list of references to the identifiers of elements of type 
SegmentGroupInformationType (optional). The order of the 
references to segment groups in this list determines their ordering 
within this group. 

Locates a key frame of the segment group within a program in 
terms of a time point (optional). Defined as an MPEG-7 
datatype, MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a 
detailed description). MediaDuration and MedialncrDuration 
elements of a KeyFrameLocator element shouldl not be used. 
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Groups 



15 



KeyFrameLocator 



20 



Multiple key frames may be associated with a single segment 
group. 



groupID 



The unique identifier of the segment group. 



groupType 



The type of the segment group. A list of the valid segment group 
types is defined by SegmentGroupTypeType. 



ordered 



Specifies whether the given segment group presents an ordered 
list (i.e. whether order of the segment or segment groups within 
the given segment group is significant) (optional). 



numberOfSegments 



The number of segments in the segment group (optional). The 
value of this attribute specifies only the segments that are direct 
members of the segment group. 



numberOfKeyFrames 



The number of key frames in the segment group (optional). The 
value of this attribute specifies only the key frames of the 
segments that are direct members of the segment group. 



duration 



The sum of the durations of the segments contained within this 
group (optional). This duration corresponds to the sum of the 
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5 



durations of the segments that are direct members of the segment 
group. 



topLevel Specifies whether the given segment group is a top-level group 

(optional). 

version The version number of the segment group (optional). 



10 SegmentGroupTypeType A simple type that specifies the valid types of segment groups. 

The allowed types may be defined as follows: 

highlights - The group of segments represents selected highlights from 
one or more programs. The segments that constitute a highlight group 
are presented seamlessly in sequence, without any temporal 
15 interruptions. 

highlights/objects - The group of segments represents selected highlights 
from a program (or programs) that share a common object or objects 
(e.g. Seinfeld highlights with Kramer). 
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highlights/events - The group of segments represents selected highlights 
from a program (or programs) that share a common event or events (e.g. 
touchdowns in the Super Bowl). 

bookmarks - The segment group defines a set of access points to a 
program. If the member segments of a segment group of type 
bookmarks contain segment duration information, this duration 
information shall be ignored, and the segments shall be treated as "open- 
ended". 

bookmarks/objects - The segment group defines a set of access points to 
program, where the selected access points share a common object or 
objects. If the member segments of a segment group of type 
bookmarks/objects contain segment duration information, this duration 
information shall be ignored, and the segments shall be treated as "open- 
ended." 

bookmarks/events - The segment group defines a set of access points to a 
program, where the selected access points share a common event or 
events. If the member segments of a segment group of type 
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bookmarks/events contain segment duration information, this duration 
information shall be ignored, and the segments shall be treated as "open-ended." 

themeGroup - The segment group comprises segments that share a 
common topic or theme. The common theme can be specified in the 
segment group description. A theme group does not necessarily require 
direct continuous playback. 

preview - The segment group defines a preview of a program. 

preview/title - The segment group defines a preview of a program, where 
the preview serves as a promotional title or trailer for the program. 

preview/slideshow - The segment group defines a preview of a program, 
where the preview serves as a compact slideshow of the program content. 

tableOfContents - The segment group defines a navigable table of 
contents for the program. 

synopsis - The segment group provides a summary or synopsis of the 
program. 



shots - The segment group provides a list of the shots in the program. 
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alternativeGroups - Each member of this type of segment group provides 
an alternative view of representation, with the same functionality but 
different durations or levels of detail. 



other - The functionality of the segment group does not fit into any of the 
other types defined. 

Various validity constraints may be imposed on the proposed description scheme 
to ensure that (i) it fits the data model of FIG. 1 1, and (ii) the sequence and relationships of the 
various segments and segment groups are unambiguously defined. These constraints, which are 
implicit in the description schemes, are outlined below for clarity: 

(a) A segment group may contain either segments, or subgroups, but not both. 

(b) A segment group of type "alternativeGroups" may not contain segments and 
shall only contain subgroups. 

(c) A segment group of any type other than "tableOfContents" and 
"alternativeGroups" may only contain segments. A group of type 
"tableOfContents" may contain other segment groups of type "tableOfContents". 

These validity constraints reduce the complexity of the resulting descriptions by 
limiting the degree of nesting in the hierarchy. The navigation order of segments or segment 
groups is determined by the order of references to the segments in a segment group. 

The entities may be defined as follows: 
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15, 



Program 



Program Location 



Segment 



Segment Group 



The program entity represents an editorially coherent audiovisual 
content. 

Program Location provides a physical location where the program 
is available. A program may be available at multiple program 
locations; however, the time lines of the different instances of a 
program are preferably identical. 

A segment is a continuous fragment of a program. A particular 
segment should belong to a single program, but it may be a 
member of multiple segment groups. 
A segment group is a collection of segments that are grouped 
together, for a particular purpose or due to a shared property. A 
segment group may contain segments, or other segment groups. 



The entity relationships may be defined, as follows. 
Program-to-Segment A Segment is part of a single program. A Program may contain 

multiple segments. 

20 Segment-to-Segment Group A Segment may belong to zero or more Segment Groups. A 

Segment Group may contain zero or more Segments (possibly 
from multiple Programs). 
Segment Group-to-Segment Group A Segment Group may be a member of zero or 

more Segment Groups, and it may contain zero or more Segment 
25 Groups. A Segment Group may contain either segments, or 

subgroups, but not both. 
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The following element and complex type define a structure for holding 
segmentation-related metadata. 

<elementname="SegmentInformationTable" 

type- ' tva: SegmentInformationTableType'7> 
<complexType name="SegmentInformationTableType , '> 
<sequence> 

<element name- 'SegmentList"> 
<complexType> 

<sequence> 

<element ref="tva:SegmentInformation" 

minOccurs-'O" maxOccurs- 'unbounded7> 

</sequence> 
</complexType> 
</element> 
<element name="SegmentGroupList" 
<complexType> 

<sequence> 

<element ref^"tva:SegmentGroupInformation n 
minOccurs="0" maxOccurs- 'unbounded"/^ 
</sequence> 
</complexType> 
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</element> 

<element name- TimeBase Reference" minOccurs- ! 0" maxOccurs- ? unbounded7> 
<complexType> 
<choice> 

<element name="RefMediaTime" type="mpeg7: mediaTimePointType7> 
<element name="RefURT type= !t xsd:anyURI7> 
</choice> 
</complexType> 
</element> 
</sequence> 

<attribute name- f timeUnit" type- 'mpeg7:mechaDurationType" 

use="default" value="PTlN1000F7> 
<attribute name- 'version" type- 'xsddnteger" use- ! optional7> 
</complexType> 

The names and definitions may be as follows: 

SegmentlnformationTable An element that instantiates the 

SegmentlnformationTableType. 

SegmentlnformationTableType Defines a structure for holding segmentation-related 

metadata. 
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SegmentList 



The list of the segments in the SegmentlnformationTable 



SegmentGroupList The list of the segment groups in the 

SegmentlnforaiationTable 

TimeBaseReference Defines the time base reference(s) for the current 

description. Multiple time base references can be 
specified for a single SegmentlnformationTable. These 
references can be referred to by the timeBase attributes of 
the SegmentLocator and KeyFrameLocator elements of 
the description. If no TimeBaseReference is provided in 
the description, the time base is taken to be the start point 
of the program identified by the associated CRID. If a 
single TimeBaseReference element is specified, this 
element specifies the time base for all the segments in the 
description. 

Specifies the time base reference using an element of 
MPEG-7 type mediaTimePointType (See Sec. 6.3.9 of 
MPEG-7 for a detailed description). 
Specifies the time base reference using an element of type 
any URL 



RefMediaTime 



RefURI 
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timeUnit 



Specifies the duration of the time intervals used in the 
incremental specifications of relative time points and 
duration. Default time unit is milliseconds. 



version The version number of the segment information table 

(optional). 

The terms and expressions employed in the foregoing specification are used 
therein as terms of description and not of limitation, and there is no intention in the use of such 
terms and expressions of excluding equivalents of the features shown and described or portions 
thereof, it being recognized that the scope of the invention is defined and limited only by the 
claims that follow. 
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